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ABSTRACT 

Effects of three experimental and one control strategy were in- 
vestigated in facilitating generalization and maintenance of treat- 
ment effects following two months in a token economy classroom. At 
the conclusion of treatment, subjects were randomly assigned to one 
of three maintenance strategies or a control group and returned to 
their regular classrooms. The maintenance strategies were peer group 
reprogramming, equating stimulus conditions between the experimental 
and regular classrooms, and teacher training in behavior management 
techniques. The miintenance strategies were implemented in the 
regular classroom for a two month period and then terminated. 

Results indicated a powerful treatment effect produced by the 
token economy. The average for all 44 subjects shewed behavior main- 
tenance effects from treatment du ing follow-up. The mean percentages 
of appropriate behavior for the peer group reprogramming and equating 
stimulus conditions were significantly greater than the control sub- 
jects* mean. The teacher training and control group means were not 
significantly different* 
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Tbo issue of whether treatment gains, produced by behavior 
modification techniques, do in fact generalize and maintain across 
time and across settings hss received increasing attention in the 
last fe^7 years (Baer, Wolf, and Risley, 1968; O'Leary, 1969 ). The 
amount of research data on this question is limited. However, the 
available evidence indicates that effective generalization and 
maintenance of modified behavior does not naturally occur when 
treatment procedures are abruptly withdrawn (Walker, Mattson, and 
Buckley, 1969; Birnbraucr, Wolf, Kidder, and Tngue, 1965; Kuyperc, 
Becker., and O'Leary, 1968; Patterson, Shat;, and Ebner, 1969). Un- 
less systematic fading procedures are used (O'Leary, Evans, Becker, 
and Saudargas, 1969) or efforts ate made to reprogram the environ- 
ment in which maintenance is expected (Walker, Mattson, and 
Buckley, 1969) the probability is substantially reduced that main- 
tenance of the modified behavior will oc m,, r automatically or 
naturally. 

There is also evidence to indicate that behavior is situation 
specific and very responsive to the setting events, reinforcement 
probabilities and discriminative stimuli that operate in different 
settings (Patterson and Cobb, 1970). Thus int ro-eubject behavioral 
similarity across different settings is probably a function, in 
part, of the amount of stimulus similarity that exists between such 
settings. When intervention in one setting alters these controll- 
ing variables and behavior change is produced, the failure of the 
treatment effects to generalize to settings in which these variables 
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have riot been altered Is to be expected. Studies reported in the 
literature Indicate that generalization of treatment effects from 
treatment to nontreatment settings while treatment Is on-golng Is 
the exception rather than the rule. (Wahler, 1969; Kuypers, Becker, 
and O'Leary, 1969; Keichenbaun, Bowers, and Poss, 1969; O'Leary, 
Becker, Evans and Saudargas, 1969; Walker, Mattson and Buckley, 1969). 

To date, no studies have been conducted which document long- 
term maintenance effects following treatment In a token economy In 
which behavior modification procedures have been used. Studies 
that have evaluated short tern maintenance effects have indicated 
T\ need for systematic research on strategies which facilitate 
generalization and maintenance across time and across settings. 

The present study investigated the effects of three experimental 
and one control strategy in facilitating generalization and main- 
tenance of treatment effects following two months of treatment in 
a token economy. 



Method 

Subjec ts 

Subjects for the study included UU male and female subjects in 
grades three, four, five, and six who were referred to an experi- 
mental classroom by the local school district because of academic 
and behavioral problems experienced in the regular classroom set- 
ting. Local schools referred those children who were so disruptive 
that reguLar teachers had difficulty accommodating them in the 
classroom setting. Selection criteria consisted of average or 
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above average intellectual ability* inadequate academic performance, 
and socially deviant behavior occuring within the regular classroom 
setting. All subjects possessed a number of social behaviors that 
interfered with the learning process. Teacher defiance, non- 
attending, hyperactivity, and tantrum behavior were attributed to 
the group as a whole. Individual behaviors exhibited were physical 
and verbal abuse of peers, rejection of peer initiations, excessive 
verbal outbursts and non-compliance with teacher instructions and 
demands. These behaviors were identified as most irritating to 
the regular classroom teacher. However, the subjects as a group 
exhibited many additional behaviors illustrative of inadequate 
social and academic adjustment. All candidates for the experimental 
classroom were screened with the Walker Problem Behavior Identi- 
fication Checklist (Walker, 1970) and baseline observations taken 
in the regular classroom setting prior to placeuient in the experi- 
mental classroom. All subjects scored average or above average 
on standardized intelligence tests (WISC; Stanford-Binet ; CTMM) 
but had educational deficits in the basic skill areas of reading 
and math that ranged from one month to three years, nine months 
below grade level. 

Set t ing 

The classroom facilities for the treatment program were ad- 
joining and affiliated with a public elementary school in the local 
school district. The primary area for academic activities con- 
tained six, double desks (approximately 20" x 45" work surface), 
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the: teacher's desk and shelves, and tables for the display of 
high Interest materials. Adjoining :ooms provided sink and table 
facilities for science and art projects, a carpentry room with a 
variety of tools and wood, and the necessary observation facil- 
ities. Space was also available for Individual testing, tutor- 
ing, and remedial instruction. A small isolation roar., for using 
time-out procedures, adjoined the main classroom area. The child- 
ren used the same playground and lunch facilities as the regularly 
enrolled students in th 2 school. 

There were 32 elementary schools in the local district. During 
the course of the study, children were referred and accepted into 
the experimental classroom from 26 of the 32 elementary schools. 

The district had 21,700 full-time students and the teacher-pu^il 
ratio was 1:24. This ratio did not include teacher aides, resource 
teachers, special education teachers, or counselors. 

Desig n 

In the fall of 1968, a two year study vns begun to investigate 
three experimental strategies and one control, strategy in facilitating 
generalization and maintenance of treatment effects following tvo months 
of treatment in a token economy. The token economy was administer- 
ed within an expetimental classroom setting that accommodated six 
children at a time. A complete description of the treatment pro- 
gram in the experimental classroom is contained in Walker, Mattson, 
and Buckley (1969). Over the two year period, a to' 1 of 48 subjects 
received two months of treatment within the token economy. Four 




children each received two months of treatment 
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during each academic year. Four subjects were not included in 
the study as their parents moved away from the area before the 
investigation was concluded. At the conclusion of two months 
of treatment in the experimental classroom, individual subjects 
within each of the eight treatment groups were randomly assigned 
to one of three experimental or one control group for purposes 
of jitudying maintenance effects. The random assignments were not 
made until the last week of treatment in the token economy to 
preclude subjects 1 receiving differential treatment by the experi- 
menters or teachers due to their placement in a particular ex- 
perimental maintenance group or a control group. After the random 
assignments had been made, the six subjects were returned to 
their respective, regular classrooms. The maintenance and control 
strategies were implemented for each subject in his regular class- 
room following treatment in the token economy. The maintenance 
and control strategies were kept in effect for a two month period 
in the regular classroom and then terminated. Thus, over the two 
year period of the study, a total of 44 subjects received two 
months of treatment in the experimental classroom and were followed 
up, in either an experimental or control strategy, for a two month 
period. During the maintenance period following treatment, the 
44 subjects were divided into four groups of 11 subjects each. 

Three of these groups were used for studying three separate main- 
tenance strategies while the fourth served as a control and pro- 
vided an index of "unprogratnned*' generalization and maintenance 
following treatment. 
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Procedures 

Exp erimental Group 1 (Peer Group Reprogramming) 

In this maintenance strategy, the experimental subject’s peer 

i 

group was reprogrammed so as to support his attempts at appropriate 
social and academic behavior and to ignore incompatible behaviors 
such as nonattending, disrupting the class, initiating to peers 
during study time, etc. The strategy was designed to maintain the 
subject's post treatment, appropriate behavior in the regular 
classroom setting by enlisting the support and cooperation of his 
peer group in helping him control his behavior '(Patterson and 
Anderson, 1964). J 

When the subject returned to his class, a ontingency was 
implemented in which he had an opportunity to aaru points for 
appropriate social and academic behavior. Whr n the subject earned 
a predetermined number of points (100) , he ev hanged them for a 
group reinforcement for the entire class. Gi iup reinforcements 
included field trips, cartoon films, class prrties, and trios 

to special school events such as high school basketball games, 

j 

etc. During the tv:o month maintenance perio-', the experimental 
subject had an opportunity to earn points for himself and his 
classmates during two, 15 minute periods sch duled twice a week. 

At two fixed tiroes during each week, a stall member would visit 

t 

J 

the classroom and operate a signalling unit jor monitoring the 
subject's performance and for recording reinforcements. The unit 
was designed by the project staff and contained two counters, two 
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stimulus lights, and a bu 22 er for signalling the experimental 
subject. The unit was radio controlled and could be operated 
up to 300 feet away. When the staff member entered the room, he 
placed the unit or the child* s desk so the class as well as the 
experimental subject could observe the stimulus lights. He then 
returned to the corner of the room and began operating the unit. 

The unit contained a green light matched with a plus cornier and 
a red light matched with a minus counter. When the green light 
was on, it signalled that the experimental subject *s behavior was 
appropriate and that he was earning points on the plus counter. 

The subject could earn a maximum of 10 points during each 30- 
minute cession. Reinforcements were delivered on a variable inter- 
val schedule. Each reinforcement was audible to the experimental 
subject as he could hear the counter click as it registered one 
point. Each reinforcing event was visible f . the experimental 
subject and the entire class as the stimulus light temporarily 
■horted out, causing a flash, whenever a point was registered on 
the counter. When the subject produced inappropriate behavior, the 
experimenter extinguished the green stimulus light i d activated 
the red etimulu3 light. This signalled that the experimental 
subject's behavior was inappropriate and that lie had ten seconds 
to modify his behavior or he would begin losing points, on a 
variable interval schedule, on the t%^d ccunter. Activation of 
the red light was accompanied by an audible buxzer which signalled 
to the subject and his classmates that his behavior was inappropriate. 
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At the end of the 15<minute period a net total of earned points 
was obtained by subtracting the number of points on the minus 
counter from the number of points on the plus counter. The 
total war then announced to the class. This event was usually 
accompanied by applause from the experimental subject’s cJr^s- 
mates and by congratulations and praise for his performance. 

The total was recorded for each sessicn, by a peer, on a therm- 
ometer chart located on the wall of the classroom. 

The experimental subject had to a thieve the right to earn 
points for himself and his classmates by producing behavior that 
was acceptable, on the average, to hi3 teacher. Acceptable 
behavior Included exhibiting study behavior, completing assign- 
ments on time, not disrupting the clsss and so on. It was left 
up to each experimental subject’s teacher to determine what was 
acceptable and what was not acceptable. If the subject pro- 
duced a protracted piece of inappropriate behavior between the 
two sessions, the teacher was instructed to notify the project 
staff and the next scheduled visit by the experimenter would be 
cancelled. The teacher announced to the class that the next 
session v;as cancelled and specified i;he behavior of the experi- 
mental subject that resulted in the nancellat ton. At this point, 
the experimental subject began earning the opportunity for the 
next scheduled session, after the cancelled one. 

Each subject’s teacher was given a set of instructions for use 
in explaining the reprogr aiming strategy to the experimental sub- 
ject’s classmates. The strategy was explained and discussed 
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immediately prior to the subject's re-entry to the cl^ss on a 
full-time basis. The project staff explained and discussed the 
strategy with the experimental subject the week he returned to his 
regular classroom. The instructions to the classroom teacher are 
presented below. 

1. "You, the teacher, explain to the class that has 

been attending an experimental class for the last two 
months. While there, he has made impressive academic gains 
and he has learned to work better and complete his assign- 
ments on time. We would like to enlist the cooperation of 
the class in helping him continue this good work in his 
regular classroom. 

2. If they, as a class, learn to ignore his attention getting, 
disrupti/e, and non-study behavior and to support his 
appropriate behavior (listening to instructions, complet- 
ing assignments, not disrupting the class) then a visitor 
V7i.ll come to the class occasionally and operate a box which 

will signal when has received a point for working 

well and controlling his behavior. 

3. When accumulates ICO points, then he exchanges them 

for a special activity for himself and the entire class. 

The class can decide what ti . special activity will be. 

4. Emphasize that the visitor will come only if *s 

behavior is appropriate all the time, not just immediately 
prior to his scheduled visit." 



E xperimental Group II (Equating Stimulus Conditions) 

Subjects in this experimental group were exposed to a strategy, 
designed to facilitate maintenance , by establishing as many common 
stimulus elements between the experimental and regular classroom 
s 0 s as possible. Research evidence in the area of discrimin- 
ation learning has demonstrated that stimulus similarity or identi- 
cal elements among components of learning tasks facilitates the 
process of stimulus generalization. (Buttar, 1963; Cuttroan and 
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K illsh, 1956; Guttman and Kalish, 1958; Jenkins and Harrison, 

1960; Kallsh and Guttman, 1957; Kallsh and Guttraan, 1959)* The 
^jthors attempted to program generalization and maintenance of 
treatment effects In this experimental condition, by making the 
post-treatment environment as similar as possible to the treat- 
ment environment In the experimental classroom setting. Thus, 
a variation of the treatment model administered within che ex- 
perimental class settli as implemented for subjects in this 
condition In their respective, regular classrooms. 

The Intervention model in the experimental classroom con- 
sisted of three primary, treatment variables. These were social 
reinforcement, token reinforcement , and aversive control procedures 
in the form of cost contingency and withdrawal from n reinforcing 
climate. The maintenance srrategy for experimental condition II 
included systematic social reinforcement, token reinforcement, and 
the academic materials each subject had used during treatment in 
the experimental classroom. The aversive control procedures were 
not included in the maintenance strategy since their effective use 
requires a great deal of close supervision by experienced staff. 

Time out and coJt contingency procedures are also easily abused and used 
punltively within the regular classroom setting. Thus three 
sources of stimulus matching were programmed between the experi- 
mental and regular classroom settings. These were academic mater- 
ials, systematic social reinforcement, and token reinforcement. 

As in experimental condition 1, the project: staff explained 
the maintenance strategy to the subject immediately prior to his 

me 
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return to his regular classroom. A set of written Instructions 
were designed for the regular classroom teacher to use in imple- 
menting the maintenance strategy. These instructions are present- 
ed below. 

"For a two month period, you as r s teacher, will be 

provided with the following materials. These materials were 

used by in the experimental classroom and should be 

the instructional bases for language, reading, and spelling 
during this period* 

1. Academic (materials varied for each subject) 

1 . 



2 . 



3. 



Roi nforcer System - You will be provided with 40 blue sheets 
to be used in recording points. Place a new sheet on the 
child*s desk each day and save the record forms in a folder. 
has already selected the items he would like to ex- 
change his points for. Each item requires an earned total 

of 100 points. It Is possible for to earn approximately 

cr.e item per week. The experimenter, Mr. will visit 

weekly to answer question, give assistance, and bring earned 

items. The observer, Ml*. vill visit one or two tines 

per week to tj<e observations on the child only. He has not 
been told the treatment strategy being used with the child 
so he will he unable to answer any questions. He will enter 
the room quietly, sitting at the back of the room and remain 
only about 30 to 60 minutes. 

R einforcement Program - for appropriate social and academic 
beh avior. 

1. You ate provided with a blue point record form which is 

divided into 50 squares: (1) 25 points for good academic 

production (2) 25 points for good student behavior. A 

luaximun of 2^* points total can be earned by In 

any single day. 

2. Using a marking pen (felt) award points according to the 
following schedules: 



; o 
ERIC 



II. 



III. 
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1. Academics s Check the child* s academic work four 
(4) times a day for correctness, neatness, com- 
pletion within allotted time, etc. A good time 
to evaluate is toward the end of bloc activities 
such as math, reading, spelling, language and so 
on. If his work is acceptable, satisfactory, or 
meets stated criteria, administer a maximum of 
thr ee points per evaluation. Thus , f >r ac ademics , 
_a child cou; d earn a maximum of_ t we Ve (12} poi nts 
per day. 1£ his work is satisfactory, but barely 
so, you may want to administer two points or one 
point instead of the three. If his work is un- 
satisfactory, you administer ivo points for that 
evaluation. 

2. Socia l Behavior : For appropriate social behavior 

(Examples: paying attention, listening to and 

following instructions , completing assignments, 
good playground behavior etc.) e valuat e the ch ild 
four (4) times duri ng the, day^ lor example at 
10:15 a.m. , 11:45 a.tn. , 1:30 p.m. r'p.nd 3:00 p.ri. 

If the child’s behavior has been acceptable during 
the preceding tlr.e period, reinforce hin with a 
mavirtun of three points per ev aluati on. . Thus a 
child could earn a total of twelve (12) points 
during thj3 da£ for appropri ate social behavior 

If his behavior has been satisfactory, but not 
exemplary, two points or one point could be ad- 
ministered. If his behavior has not been satis- 
factory between 10:15 and 11:45, then no points 
would be awarded at the 11:45 evaluation. 

3. S ocial Reinforcemen t : It JLs extremely imp o rtant that 

you pair each administration of an earned point with 
come forn of overt , social reinforcement such as praise 
("good work" "excellent", or "fine job"), approval, 
interest, attention and/or affection. In this way, 
natural cocial reinforcement from ycu comes to have 
the sans effect upon behavior as points. However, it 
is important that you do not^ verbally reprimand the 
child when points are withheld." 

The project staff met with the classroom tcache r prior to 
the experiment il subject’s return to the regular classroom and 
discucsed the written instructions. During the session, the 
staff answered questions about the maintenance procedures and 
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made sure the teacher understood them. The experimental class 
teacher explained the programmed, academic materials and demon- 
strated their use to the regular classroom teacher. The level to 
which the experimental subject had progressed in the materials 
was indicated to his teacher and she was instructed to have him 
continue from that point. 

The experimenter who managed the maintenance strategies was 
introduced at this time and a schedule set up so he could visit 
the classroom onca each week during the two month follow-up 
period. The experimenter^ task was to insure that the teacher 
implemented the maintenance strategy and to provide whatever 
assistance the teacher required. However, the experimenter did 
not provide training in behavior modification techniques to the 
teachers in this condition. 

Since the experimental subjects did not spend the entire 
school day with their homeroom teachers, a rating system was set 
up to monitor their performance in other settings within the school 
setting. The child carried a rating slfp with him during the dry 
and other teachers, playground attendenl.s, and the lunchroom 
manager evaluated his behavior in these settings. Points were 
awarded by the teacher foi these periods, on the basis of ratings 
the child received. 




Experimental Condition III (Teacher Training) 

In this condition, the project staff provided the experimental 
subject’s regular classroom teacher with training in behavior 
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modification techniques in an attempt to facilitate generaliza- 
tion and maintenance of treatment effects. The purpose of this 
maintenance strategy was to program the classroom teacher to re- 
inforce and support the experimental subject’s modified behavior. 

In this condition, it was necessary to maintain the teacher’s 
as well as the experimental subject’s behavior. Each subject’s 
teacher was contacted and asked if she would like to participate 
in a maintenance study when he returned to his regular classroom. 
None of the teachers contacted refused. Requirements of the 
teacher during the maintenance period were explained and discussed. 

Each teacher was enrolled in a division of continuing education 
class on contingency management. Teachers in this condition 
attended no formal classes. However, they were required to read 
and master a semi-programmed text on applications of behavior 
modification techniques in the regular classroom setting (Buckley 
and Walker, 1970). The teacher met with the maintenance Supervisor 
and discussed applications of the principles contained ir, the text. 
The experimenter provided the teacher with direct training in te- 
havior modification techniques and served as a resource consultant 
in her application of behavioral principles in maintaining the 
experimental subject’s behavior. After a series of initial training 
sessions the experimenter visited the class on a weekly basis. 

The experimenters attempted to control classroom sequencing for 
the subject so that the training teacher had the child for all 
basic skills areas. 



15 



During the last week the subject was in the experimental 
class, the regular classroom teacher was invited to spend a day 
in the experimental class setting. During the morning session, 
the teacher observed the class from behind one way glass and the 
project staff explained Jne treatment program to her. During 
the afternoon, the teacher worked with the experimental subject 
on academics and received practice in reinforcing him for appro- 
priate behavior. 

At the end of the two month maintenance period, the regular 
classroom teacher received three hours of credit for the class on 
contingency management and her tuition was paid by the project. 

She was informed of these reinforcing consequences when first con- 

; tacted about participating in the study. 

i 

Experimental Group IV (Control) 

In this condition, experimental subjects were returned to 

| 

i their regular classrooms, after two months of treatment, with no 

i 

i 

| follow-up support or efforts at programming maintenance. The pro- 

ject staff held a conference with the school and provided results 
of the subject’s academic progress in the experimental classroom. 
When asked about follcw-up support, the project staff indicated that 
the experimental subject would be observed on a weekly basis for 
a two month period but that the project's involvement in providlnc 

S treatment ended when the child returned to his regular classroom. ^ 

o 

ERIC 
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Staff Time Per Maintenance Group 

The ratio of staff time expended to amount of behavior change 
produced has been discussed by Patterson, Cobb, and Ray (1970) 
as an important variable in the evaluation of intervention pro- 
cedures, The experimenters recorded the total amount of staff 
tine required to implement the maintenance strategies for subjects 
in each of the four groups. Experimental group 1 required an 
average of four hours of staff time for each subject plus a one 
hour conference with the school personnel involved. Experimental 
groups 2 and 3 and the control group required respectively seven 
hours, nine hours, and zero hours of staff time for implementa- 
tion. Each group also required a one hour conference with the 
school. 

Observation Procedu re s 

A school observation form, developed by Ray, Shaw, and Patter- 
son (1969) was used to measure defined classroom behavior in this 
study. The observation form provides for a .method of * charac- 
terizing* school situations for a given child in such a way as 
to facilitate understanding the determinants and consequences of 
social behaviors as well as the relationship of those behaviors 
to the classroom setting. j>. if,. The 13 response codes on the 
form are divided into seven inappropriate and six appropriate 
categories of classroom behavior. Inappropriate categories in- 
clude noisy, aggressive, not attending, peer initiation, initia- 
tion to peer, movement around the room and inappropriate task. 
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Appropriate behavior categories include individual work, appro- 
priate group behavior, reciting, volunteering, teacher initia- 
tion, and initiation to teacher. Each response code is operation- 
ally defined in the manual for the observation form. Criteria are 
established for each response code along with examples of same. 

The form also contains codes for the classroom setting, the 
social consequences of child behavior and the social agent supply- 
ing the consequence. During each six-minute observation session, 
the activities of the classroom setting are coded as group, individ- 
ual, transition, or recess. The social consequences of child 
behavior are coded as no response, attention, praise, compliance, 
disapproval, non-compliance, and physical (+ or -) * The social 
agent supplying the consequence is coded as teacher, peer, or 
observer* 

The observation form is set up as a grid. Each horizontal 
line lit f;he grid defines a fifteen -second interval. The six- minute 
grid is further subdivided into two-minute sections for observer 
convenience in reading the behavior codes. Using an observation 
clipboard, set for fifteen-second intervals, the observer moves 
down one grid line each time he receives a signal from the clip- 
board* luring each fifteen-second interval, the observer vecords 
both the behavior of the subject and the social consequences of 
hi9 behavior by placing the appropriate consequence and agent 
notationfs) in the space beneath the appropriate behavior CGd** 

More than one behavior category can be coded during a single fifteen- 
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second Interval. However, once coded, the same category cannot 
be recoded during the fifteen-second Interval. : 

k graduate student in school psychology was hired as a research 

| 

assistant on the project and served as an observer In the regular 



classroom setting. He recorded baseline and follow-up observations 

In the regular classroom setting on each group of subjects who re- 

i 

celved treatment In the experimental class setting. The observer 
was at no time Informed of which subjects were as; 
various maintenance groups. Practicura students ( 
special education were trained to take observatlo 
perlmental subjects during treatment. Observatic 
through one way glass from an observation room ac\ 
classroom. 



lgned to the 
;raduate) In 
s on the ex- 
is were taken 
Joining the main 



Reliability 

The observer In the regular classroom settin 
baseline and follow-up observations was given th > 
for the observation form developed by Ray et. al 
memorized the operational definitions for the re 
familiarized himself with the grid system, social 
sequence codes. After some Initial practice in 
tions in the experimental class setting, he accc : 
training observer to regular classrooas for praci 
observations on subjects who had been selected f 
the experimental class, The training observer v: 
taking observations in both the experimental anc 

ERJC settings. 
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Inter-rater reliabilities were calculated by a percent agree- 
ment method in which number of agreements was divided by the 
total number or time intervals. Agreements were defined as two 
observers coding the same consequence and agent events under the 
appropriate behavior category in a given fifteen-second interval. 

The observer r as reauirad to reach a c i-iter.doa of five consecutive 
two-minute observations of .80 or better with the training observer. 
Two separate, observation sessions were required to reach criterion 
in the regular classroom setting. In the first session* 21 
observation trials of two minutes duration were completed Relia- 
bilities during these trials ranged from .25 to 1.00 and averaged 
.62. In the second session, 12 trials were completed before 
criterion was reached. Reliabilities between the two * servers 
ranged from .75 to 1.00 during these trials and averaged .93. 

Observation data were recorded by practicum students in 
special education dut.u : treatment within the experimental class 
setting. Observations were taken through one way glass from an 
observation room adjoining the main classroom, An inter-com system 
allowed observers to audibly monitor activities in the experi- 
mental classroom. Over the tv?o year period, a total of 10 graduate 
students were trained find used as observers. Each student vas 
trained by the training observer and served r minimum of three 
months as an observer in the experimental classroom. Each student 
was required to achieve a criterion of 10 consecutive observations 
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of ,90 or better with the training observer. The observers re- 
quired an average of 21.7 two minute observation trials to achieve 
criterion. Inter-rater reliabilities during these trials averaged 
.84 and ranged from .12 to 1.00. 

Results 



Tre< it me nt Effects 

An analysis of variance for a repeated treasures design (Winer, 
1962) was used to analyze the baseline, treatment, and follow-up 
data for all 44 experimental subjects. Scores for each subject 
were the mean percentage of appropriate bcha/ior produced dur- 
ing aaselire, treatment, and follow-up. Eac* data point in base- 
line was based on an average cf 10, six rainu :e observations taken 
In tie regular classroom. Treatment scores were based on an aver- 
age of 64, six- minute observations taken in :he experimental class- 
room. Follow-up scoics were based on an average of 32 observa- 
tions teken in the regular classroom following treatment. 

Insert Table 1 About Here 

The F ratio of 257.07 in Tabic 1 indicates tie intervention pro- 
cedures in the experimental classroom produced a very powerful 
treatment effect. The mean percentage of appropriate behavior for 
all 44 subjects in baseline was 44.59. During treatment, the mean 
percentage of appropriate behavior for the same subjects increased 
to 90.29. During follow-up, thu mean percentage was 65.27. The 
^'^f^n-Keule test for pair-wise differences was used to examine 
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all possible differences between baseline, treatment and follow- 
up means for statistical significance. 

Insert Table 2 About Here 

The data In Table 2 indicate that all possible mean differences 
were statistically significant at p Thus, both the treat- 

ment and follow-up means were significantly different from base- 
line. In addition, the treatment and follow-up means were also 
significantly different. 

The treatment program also affected variability in behavioral 
rates across subjects. For example, during baseline the mean 
percentage of appropriate behavior varied from 20 to 67. During 
treatment, it varied from 79 to 99. During follow-up, the range 
increased and the mean percentage of appropriate behavior varied 
from 45 to 83. The standard deviations for experimental sub- 
jects in baseline, treatment, and follow-up were respectively 
13.31, 4.t\ and 9.71. 

During the first week in the experimental classroom, each 
subject was given the Stanford Diagnostic Arithmetic Test and 
the Gates-McKillop Reading Diagnostic Test. During the last 
week in the experimental classroom, a^ter two months of treatment, 
each subject was given an alternate form of the same tests. 

Insert Table 3 About Here 

The V ratio in Table 3 indicates that treatment in the experi- 
mental classroom substantially altered the subjects* measured 
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achievement in math. The mean, grade equivalent score for all 
44 subjects on the pre-test was 3.S. The mziin grade equivalent 
score for the same subjects on the post-test was 4.5. Achieve- 
ment ranged from grade level 1.5 to 5.2 on the pre-test and fron 
1.5 to 6.5 ou the post-test. 

Insert Table 4 About Here 

Inspection of Table 4 reveals that the subjects’ measured achieve- 
ment in reading was also substantially changed. While the effect 
v?as not as powerful as that produced in math achievement, it was 
statistically significant beyond .001. The mean grade level score 
in reading on the pre-test was 3.6. On the post-test it was 4.5. 
Mean achievemert scores ranged from 1.3 to 7.3 on the pre-test and 
from 1.8 to 8.6 on the post-test. 

Maintenance Effect s 

Prior to evaluating maintenance effects, it was necessary to 
test the effectiveness of the randomization procedures used to 
assign subjects to experimental and control groups following 
treatment. An analysis of variance for a completely randomized 
design was used to test for differences among subjects in the 
four maintenance group9 in percentage of appropriate behavior 
produced during baseline and during treatment. Analyses were 
also conducted on the suoject9’ performance on the post-tests in 
math and reading achievement. F tests were run for the four 
groups on mean percentage of appropriate behavior produced in 
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baseline and on mean percentage of appropriate behavior produced 
during treatment. These F ratios, with 3 and 43 df. were 1.32 
for beeline and 1.13 fox treatment p *.05. Analysis of the four 
groups' performance on the pre-test and post-test in math achieve- 
ment yielded F ratios respectively of 2.28 and .92 p > . 05. The 
same analyses on the pre-test and post-test data in reading achieve- 
ment yielded F ratios of 1.01 and .73 p‘*.05» Thus the random- 
ization procedures were effective in removing any systematic diff- 
erences among the four maintenance groups in percentage of appro- 
priate behavior produced and in measured achievement in math and 
reading. 

An analysis of variance for a completely randomized design 
was used to analyze maintenance effects among the three experi- 
mental groups and one control group. These data were based on an 
average of 32, six-minute observations taken on the experimental 
subjects in their regular classrooms during the two-month follow- 
up period. 

Insert Table 5 About Here 



The F ratio in Table 5 indicates there were significant differ- 
ences among the maintenance groups in naan percentage of appropri- 
ate behavior produced during the two month follow-up period. A 
post-hoc-analysis of the means was conducted to isolate the statist- 
ically significant mean differences. 
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Results of this analysis in Table 6 indicate the means of experi- 
mental groups one and two were significantly different from the 
mean of the control group. A mean difference of 7.93 or greater 
was required for significance at p -1,05. The mean difference of 
5 between experimental group 3 and the control group was thus not 
statistically significant. 

An analysis was conducted to determine if the variances of the 
experimental and control groups were significantly different during 
the maintenance period. An F-maxiraum Test for Homogeneity of Var- 
iances was applied to both the treatment and the maintenance data. 

Insert Table 7 About Here 

Inspection of Table 7 indicates the variances of the experimental 
and control groups were homogeneous during treatment in the experi- 
mental clausrcom setting. However the variances of these same 
groups were significantly different during che follow-up perioc and 
were thus heterogenous. The maintenance procedures thus produced 
significant differences in the variability as well as the amount 
of appropriate behavior produced by the experimental subjects in 
follow-up. 



Discussion 

As noted earlier, application of the treatment model had a 
powerful effect across subjects in the amount of appropriate be- 
havior produced and in measured math and reading achievement. 
The difference between the treatment mean of Q0.29 and the 
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follow-up mean of 65.27 Indicates the experimental subjects main- 
tained 72 percent of the average amount of appropriate behavior 
produced during treatment. When analyzed by maintenance groups, 
the data indicate that subjects in experimental group 1 (peer 
group reprogramming) maintained 77 percent of the amount of appro 
priate behavior produced during treatment. The data for subjects 
in experimental group3 2 (equating stimulus conditions) , 3 (teach 
er training) and control were respectively 75 percent, 69 percent 
and 65 percent. There was also r .a inverse relationship between 
the amount of staff time invested in the three experimental 
maintenance groups the amount of behavior maintenance pro- 
duced. The experimental group (teacher training) in which the 
greatest amount of staff time (nine hours) and resources were 
invested was the least effective in producing maintenance. Con- 
versely, the experimental group (peer group reprogramming) in 
which the least amount of staff time wa ? invested produced the 
greatest maintenance. 

The two maintenance strategies which were most effective also 
produced the most reliable maintenance effects. Experimental 
groups 1 and 2 produced 77 and 75 percent maintenance during 
follow-up. Their reipectiv.a variances during this same period 
were 34.50 and 48.30. The variance for experimental group 3 
was 109 end it was 236 for the control group. The greater re- 
liability of the maintenance effects of experimental groups 1 
and 2 is reflected in the smaller variances of these groups. Ex- 
perimental control of maintenance variables appeared to be more 
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effective in experimental groups 1 and 2 since the authors were 
in more direct control of the maintenance procedures and were thus 
able to program and monitor th^m more carefully. In the peer group 
reprogramming strategy, individual classroom teachers were directly 
involved only in giving initial instructions to the class and in 
contacting the experimenters to cancel a scheduled visit. Thus 
even an uncooperative teacher would have very little effect upon 
the results of this maintenance strategy. Three teachers in the 
peer group reprogramming strategy were judged to be uncooperative 
by the project staff. Each of the 11 peer groups In this strategy 
appeared to be quite enthusiastic about the program and were 
cooperative during its implement ation » In the equating stimulus 
conditions strategy, ths experimenters provided the teacher with 
detailed instructions on hot; to evaluate and rate i:he child's 
performance. Fixed interval times were specified as to when the 
teacher should reinforce thp child for both social and academic 
behavior. All tangible reinforcers, rating sheets and record 
forms, aid academic materials in the basic skills area were pro- 
vided for the teacher. In addition, the project staff monitored 
the child’s progress by tracking the number of points earned and 
by discussions with the teacher. Teachers were thus programmed 
by the project staff and their execution of the maintenance strategy 
carefully supervised. However, ey.i with this amount of super- 
vision, several teachers did not use the academic materials pro- 
vided for the experimental subject. One teacher made points so 
aversive to the experimented subject that he requested she stop 
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dispensing them. This strategy also produced a reliable main- 
tenance effect; although the variance of 48.30 was larger than 
that for the peer group reprogramming strategy. 

In contrast, the variances for experimental group 3 and the 
control group reflect a great deal of inter-subject variability 
in performance during the maintenance period. The teacher train- 
ing maintenance strategy was much less effective than either the 
peer group reprogramming strategy or the equating stimulus con- 
ditions strategy in the amount of appropriate behavior produced 
during maintenance and in the reliability of the maintenance 
effect. The authors attribute this variability to differences 
among teachers in the motivation, training, aud cooperation 
necessary to implement the maintenance strategy effectively. In 
addition, all teachers were given identical levels of training in 
behavior modification techniques and then supervised in their 
application of these techniques. The project staff did not suggest 
specific procedures fo t . the teacher to use; but provided the 
teacher with support and supervision in those techniques she chose 
to use. Thu9 some teachers established token economies for the 
experimental subject while others relied upon time out procedures 
and teacher dispensed social reinforcers. These two sources of 
variation undoubtedly contributed to the differential effective- 
ness of this strategy in maintaining appropriate behavior follow- 
ing treatment. Seme teachers were very responsive to the train- 
ing procedures and subjects in their classrooms maintained li'gh 
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levels of appropriate behavior. Other teachers were much less 
enthusiastic about the maintenance program and were less coopera-' 
tlve In Implementing specific maintenance procedures* The amount 
of appropriate behavior produced by,- experimental subjects In these 
classrooms tended to be substantially lower. 

There are a number of procedures which might have made the 
teacher training strategy more effective 4 i producing maintenance. 
For example, providing more intensive, initial training in be- 
havior modification techniques using modeling, feedback, and hand- 
shaping procedures would have increased the teachers* skill level. 
Providing the teacher with video-tapes of her performance during 
acquisition and providing he; r with frequency counts on the correct 
use of reinforcement procedures may have substantially improved 
her performance. Setting up weekly "data" sessions in which the 
teacher was informed of the experimental subject’s amount rf 
appropriate benavior for that week would have provided support 
for the teacher’s behavior, Tn addition having each teacher agree 
to a performance contract in which her grade is contingent upon 
the amount of behavior maintenance produced could improve per- 
formance, A criterion could be established where an average of 
75 percent maintenance or more is required for an A grade, An 
average of 65 to 75 percent would be equivalent to a B grade. An 
average of below 65 percent would result in an incomplete end 
possible retraining. There is very little data available on Just 
how much training is necessary to equip the classroom teacher with 
O ficient skill in behavior modification techniques so she can 
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apply them effectively In the regular classroom setting. The 
question of whether the teacher’s effective use of these techniques 
maintains over time is an empirical one. Acquainting the teacher 
with a new management or teaching technique mut‘1 be accompanied 
with the necessary support and supervision when the technique is 
introduced into the classroom regimen. The teacher is often pun- 
ished with no change in behavior or changes in the wrong direction 
when she experiments with behavior modification techniques in the 
classroom. Unless provided with experienced back up support, 
the teacher may reject these techniques before she becomes pro- 
ficient with them. 

Subjects who were assigned to the control group shewed a 
great dual of variability in the amount of appropriate behavior 
produced during follow-up. The variance for the control group 
during treatment was 21.30. During follu*-up, it was 236. The 
effect cf implementing maintenan *e strategies for the three 
experimental groups was to establish homogenous conditions across 
classrooms within each experimental condition. However, control 
subjects were, in a sense, assigned to 11 different treatments 
since teachers and school personnel were free to program mainten- 
ance in any way they chcse. The effect of these heterogenous 
treatments is undoubtedly reflected in the large variance for 
the control group. 

Tha results of this study suggest the peer group ?s a power f 
source for programming behavior maintenance following treatment in 
O a token economy. The economy of this technique end the reliability 
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of its effect establishes its generality as a 'treatment as well 
as maintenance procedure. The effect of the equating stimulus 
conditions strategy Is less reliable and it is} quite expensive in 



terms of materials and invested teacher time. 



The teacher train- 



ing strategy has a great deal of appeal since it has an obvious 



multiplier effect, A well trainee teacher car 
management techniques to the experimental subj 
other members of the class. However, addition 
ed on effective techniques for training teacher 
management techniques. 
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Footnotes 

Th?s research was supported by U.S.O.E. Grant OEG 4-6-061208 
0571 Assessment and Treatment of Deviant Behavior In Children. 

The authors wish to express appreciation to Mr. Tom Hochstatter 
for his generous cooperation and support during the study. As 
principal of the school in which the experimental class was 
located, his administrative skills proved vital to the success 
of the treatment program. 

If the school staff asked for suggestions for maintaining the 
child's behavior, they were told they i^ould have to devise 
their own program. 

A more stringent criterion for reliability was required In the 
experimental class setting since the range and variability of 
the subjects behavior was substantially reduced by the treatment 
program e.g. the subjects were producing study behavior a 
large percentage of the tine. Thus reliability among observers 
tended to attenuate on cat^g^vies of behavior that had very 
low frequencies such as noisy, aggressive, and movement. In 
addition, observers In the experimental classroom changed every 
three months whereas the same observer was u^ed in the regular 
classroom setting during follow-up. The oxrerimental classroom 
observers were less experienced and tlus required additional 
training. 



Table 1 



Summary of the Repeated Measures 
Analysis of Variance of Baseline, 
Treatment, and <;oneralizatl on Scores 
For All 44 Experimental Subjects 



Source 


SS 


df 


MS 


F 


P 


Total 


58722 


m 








Subjec cs 


4919 


43 








Treatments 


46094 


2 


23,047 


257.07 


C.001 


Error 


7709 


86 


89.65 








37 



Table 2 



Newiuan-Keuls Test of Differences 
Between Baseline, Treatment, 
and Follow-Up Means 



Shapes 


' • • b l 


b 3 


b 2 

1 


Ordered Means . .. 




i 

| 2872 

f 


’ 3973 




! b l 


i 

! b 3 


b 2 


Differences 


h i 


910 


2011 


between pairs 




1101 


MS eiror = 89.65 


r= 


2 


3 


Q.99 (r, 86): 




3.76 


4.28 


MS error Q.99 (r, 


86): 


236.12 


268.78 




; b i 


b 3 


b 2 




S 


* 


* 




b a ; 




A 



*Mean difference significant beyond ,01 




38 



Sunmary of the Repeated Measures Analysis of 
Variance of Pre-Treatment and Post -Treatment 
Achievement Scores in Math 



Source 


SS 


df 


MS 


F 


P 


Total 


10, 824 


87 








Subjects 


7,156 


43 








Treatments 


2,384 


1 


2,384 


79.83 


.001 


Error 


1,284 


43 


29.86 
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Table 4 



Summary of the Rapeated Measures Analysis of 
Variance of Pre-f reatn ent and Post-Trea tment 
Achievement Scores in Reading 



Source 


SS 


df 


MS 


F 


P 


Total 


27,946 


87 








Subjects 


22,286 


43 








Treatments 


1,746 


1 


1,746 


19.18 


*:.ooi 


Crror 


3,914 


43 


91 
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Summary of the Analysis of Variance of Mean 
Percentage of Appropriate Behavior for experimental 
and Control Groups During the Two Month Follow-up Period 



Source 


SS 


df 


MS 


F 


P 


Total 


4192 


43 








Between groups 


763 


3 


234 


2.98 


<.05 


Within groups 


3429 


40 


83 
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Table 6 



Post Hoc Multiple Mean Comparisons of Experimental 
and Control Groups 1 Mean Percentage of Appropriate 
Behavior Produced During Follow-up 



Exp, Gr. 1 
x«70 

Exp , Gr. 2 
x*68 

Exp. Gr. 3 
x=63 



Exp. Gr. 2 
x=68 

2 



Exp. Gr. 3 
x~62 

1 

5 



Control Cr, 
x=59 

11 * 

9* 

A 



^Critical value of 7.93 required for significance at p .03 
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Table 7 



F -Maximum Test for Homogeneity of Variances 
During Treatment and During Follow-up 



Treatment 






Group 


Variance 


F-Maximun Ratio 


Exp . Gr. 1 


23.80 




Exp. Gr. 2 


16.90 


23.80 * 1A.90 = 1.54 


Exp. Gr. 3 


26.10 




Control 


21.30 





Maintenance 



Exp. Gr . 1 34 . 50 

Exp. Gr. 2 48.20 

Exp. Gr. 3 109 

Control 236 



236 * 34.50 = 6.94 - .05* 



^Critical value of 5.67 required for significance at p<.05 
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